Subjective and Objective Quality Evaluation of Watermarked Audio Tracks

The primary goal for evaluation techniques is to conduct valid and reliable tests which provide data for research, development, and quality control during deployment of the developed algorithms. Quality assessment of watermarked audio tracks is a significant challenge. No single objective metric to quantify the quality of an audio track AbstRAct Methods for evaluating the quality of watermarked objects are detailed in this chapter. It will provide an overview of subjective and objective methods usable in order to judge the influence of watermark embedding on the quality of audio tracks. The problem associated with the quality evaluation of wa-termarked audio data will be presented. This is followed by a presentation of subjective evaluation standards used in testing the transparency of marked audio tracks as well as the evaluation of marked items with intermediate quality. Since subjective listening tests are expensive and dependent on many not easily controllable parameters, objective quality measurement methods are discussed in the section, Objective Evaluation Standards. The section Implementation of a Quality Evaluation presents the whole process of testing the quality taking into account the methods discussed in this chapter. Special emphasis is devoted to a detailed description of the test setup, item selection, and the practical limitations. The last section summarizes the chapter.